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This work 


e Build models to predict the use of reroutes based on 
weather data 
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Challenges 
e Large amount of weather data available 
=> difficult to extract relevant features 
e Flexibility in route selection and descriptions 
=> spatially similar routes with different descriptions 
e Routes used infrequently 
=> difficult to find similarities 


e Advisory details 
e Methodology 


Identification of routes used by flights 
Identification of similar routes 
Weather feature extraction 
Development of predictive models 


e Prediction results 
e Concluding remarks 


e Advisory details 


Defining advisories 


Advisories consist of... 
e Name 
e Valid time range 
e Text description of several routes 
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Defining advisories 


Advisories consist of... 
e Name 
e Valid time range 
e Text description of several routes 


e From an origin Center or airport 
e To a destination airport 


June to August 2011 
e 1,669 reroute advisories issued 
® 735 unique advisory names 
e 34,247 routes 
e 2,770 origin-destination pairs 


Example advisory 


ATCSCC Advisory 


ATCSCC ADVZY 062 DCC 06/21/2011 ROUTE RQD /FL 


RAW TEXT: ATcScc ADVZY 062 DCC 06/21/11 ROUTE RQD /FL 
NAME: TX_ZME_2_EWR_LGA 
CONSTRAINED AREA: ZME 
REASON: WEATHER 
INCLUDE TRAFFIC: ZFW/ZHU/ZME DEPARTURES TO EWR/LGA 
FACILITIES INCLUDED: /ZDC/ZFW/ZHU/ZID/ZME/ZNY/ZOB/ZTL 
FLIGHT STATUS: ALL_FLIGHTS 
VALID: ETD 211800 TO 220100 
PROBABILITY OF EXTENSION: LOW 
REMARKS: THIS REPLACES ADVZY033. 
ASSOCIATED RESTRICTIONS: 
MODIFICATIONS: 
ROUTES: 


ORIG DEST 

ZHU LGA >HRV J37 MGM AHN J208 HPW 
J191 PXT KORRY3< 

ZHU EWR >HRV J37 SPA J14 CREWE J51 
FAK PHLBO2< 

ZME ZFW(-BNA) LGA >MEM J29 DJB CXR J146 ETG 
MIP3< 

EWR >MEM J29 DORET J584 FQM 
FQM1< 


ZME ZFW(-BNA) 


TMI ID: RRDCCO62 
211728-220100 
11/06/21 17:28 DCCOPS./nfs/lxstn18 





10 


Example advisory 


ATCSCC Advisory 


ATCSCC ADVZY 062 DCC 06/21/2011 ROUTE RQD /FL 


RAW TEXT: ATcScC ADVZY 062 DCC 06/21/11 ROUTE RQD /FL 
NAME: TX_ZME_2_EWR_LGA 
CONSTRAINED AREA: ZME 
REASON: WEATHER 
INCLUDE TRAFFIC: ZFW/ZHU/ZME DEPARTURES TO EWR/LGA 
FACILITIES INCLUDED: /ZDC/ZFW/ZHU/ZID/ZME/ZNY/ZOB/ZTL 
FLIGHT STATUS: ALL_FLIGHTS 
VALID: ETD 211800 TO 220100 
PROBABILITY OF EXTENSION: LOW 
REMARKS: THIS REPLACES ADVZY033. 
ASSOCIATED RESTRICTIONS: 
MODIFICATIONS: 
ROUTES: 


ORIG DEST 

ZHU LGA >HRV J37 MGM AHN J208 HPW 
J191 PXT KORRY3< 

ZHU EWR >HRV J37 SPA J14 CREWE J51 
FAK PHLBO2< 

ZME ZFW(-BNA) LGA >MEM J29 DJB CXR J146 ETG 
MIP3< 

EWR >MEM J29 DORET J584 FQM 
FQM1< 


ZME ZFW(-BNA) 


TMI ID: RRDCCO62 
211728-220100 
11/06/21 17:28 DCCOPS./nfs/lxstn18 





11 


Example advisory 


ATCSCC Advisory 


ATCSCC ADVZY 062 DCC 06/21/2011 ROUTE RQD /FL 


RAW TEXT: ATcScc ADVZY 062 DCC 06/21/11 ROUTE RQD /FL 
NAME: TX_ZME_2_EWR_LGA 
CONSTRAINED AREA: ZME 
REASON: WEATHER 
INCLUDE TRAFFIC: ZFW/ZHU/ZME DEPARTURES TO EWR/LGA 
FACILITIES INCLUDED: /ZDC/ZFW/ZHU/ZID/ZME/ZNY/ZOB/ZTL 
FLIGHT STATUS: ALL_FLIGHTS 
VALID: ETD 211800 TO 220100 
PROBABILITY OF EXTENSION: LOW 
REMARKS: THIS REPLACES ADVZY033. 
ASSOCIATED RESTRICTIONS: 
MODIFICATIONS: 
ROUTES: 


ORIG DEST 

ZHU LGA >HRV J37 MGM AHN J208 HPW 
J191 PXT KORRY3< 

ZHU EWR >HRV J37 SPA J14 CREWE J51 
FAK PHLBO2< 

ZME ZFW(-BNA) LGA >MEM J29 DJB CXR J146 ETG 
MIP3< 

EWR >MEM J29 DORET J584 FQM 
FQM1< 


ZME ZFW(-BNA) 


TMI ID: RRDCCO62 
211728-220100 
11/06/21 17:28 DCCOPS./nfs/lxstn18 





12 


Example advisory 


ATCSCC Advisory 


ATCSCC ADVZY 062 DCC 06/21/2011 ROUTE RQD /FL 


RAW TEXT: ATcScc ADVZY 062 DCC 06/21/11 ROUTE RQD /FL 
NAME: TX_ZME_2_EWR_LGA 
CONSTRAINED AREA: ZME 
REASON: WEATHER 
INCLUDE TRAFFIC: ZFW/ZHU/ZME DEPARTURES TO EWR/LGA 
FACILITIES INCLUDED: /ZDC/ZFW/ZHU/ZID/ZME/ZNY/ZOB/ZTL 
FLIGHT STATUS: ALL_FLIGHTS 
VALID: ETD 211800 TO 220100 
PROBABILITY OF EXTENSION: LOW 
REMARKS: THIS REPLACES ADVZY033. 
ASSOCIATED RESTRICTIONS: 
MODIFICATIONS: 
ROUTES: 


ORIG DEST 

ZHU LGA >HRV J37 MGM AHN J208 HPW 
J191 PXT KORRY3< 

ZHU EWR >HRV J37 SPA J14 CREWE J51 
FAK PHLBO2< 

ZME ZFW(-BNA) LGA >MEM J29 DJB CXR J146 ETG 
MIP3< 

EWR >MEM J29 DORET J584 FQM 
FQM1< 


ZME ZFW(-BNA) 


TMI ID: RRDCCO62 
211728-220100 
11/06/21 17:28 DCCOPS./nfs/lxstn18 





13 


Example advisory 

















e Methodology 


Methodology 


Identification of routes used by flights 
e Identification of similar routes 
e Weather feature extraction 


e Development of predictive models 


Methodology 


Identification of routes used by flights 
requires distance metric to compare routes and flight tracks 
e Identification of similar routes 


e Weather feature extraction 


e Development of predictive models 


Methodology 


Identification of routes used by flights 
requires distance metric to compare routes and flight tracks 


e Identification of similar routes 
requires distance metric to compare routes 


e Weather feature extraction 


e Development of predictive models 


Methodology 


e Identification of routes used by flights 
requires distance metric to compare routes and flight tracks 


e Identification of similar routes 
requires distance metric to compare routes 


e Weather feature extraction 
requires domain knowledge 


e Development of predictive models 


e Methodology 
e Identification of routes used by flights 


Distance metric 
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Distance metric 


; length(grid overlap) 
distance(path A, path B) = nines A),length(path B)) 
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e June through August 2011 
e Routes and flights inbound to New York Center (ZNY) 


e Define use: 
flight track and reroute overlap for at least 85% of shorter path 


e Of 4,476 issued routes, 905 were used by at least one flight 


e Methodology 


e Identification of similar routes 


20 


Cluster routes 


905 used routes grouped into 253 clusters 


Example cluster 
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Cluster routes 


905 used routes grouped into 253 clusters 


Example cluster 
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e Methodology 


e Weather feature extraction 
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Convective weather data 


Echo tops 
e Estimates of tops of clouds based on radar measurements 


e Values are discrete altitude levels 
0 ft to 50,000 ft at 5,000 ft intervals 
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Convective weather data 


Echo tops 
e Estimates of tops of clouds based on radar measurements 


e Values are discrete altitude levels 
0 ft to 50,000 ft at 5,000 ft intervals 


e 108,955 data points cover the continental US 
e 2,614,920 echo top values per hour 
Grid 
e Spatial resolution of 75 nmi by 58 nmi 
(1.25° lat by 1.25° lon) 
e 1,000 grid elements cover the continental US 
e Temporal resolution of one hour 
e 1,000 averaged echo top values per hour 
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High resolution weather data 

















Lower resolution weather data 
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e Methodology 


e Development of predictive models 
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Reduced data 
e June to August 2011 
= 2,208 one-hour time windows 
e 905 ZNY-bound routes used 
=> 253 reroute clusters 
= 20 most frequently used clusters 
(used 50 to 240 times) 
e 2,614,920 echo top data points per hour 
=> 1,000 echo top points per hour 
> 34 created features per hour per cluster 


27 


Reduced data 
e June to August 2011 
= 2,208 one-hour time windows 
e 905 ZNY-bound routes used 
=> 253 reroute clusters 
= 20 most frequently used clusters 
(used 50 to 240 times) 
e 2,614,920 echo top data points per hour 
=> 1,000 echo top points per hour 
> 34 created features per hour per cluster 
Data for model development for one cluster 
e 2,208 observations 
e 34 created features 
e class label 
+ reroute cluster used 


— reroute cluster not used 
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Model performance metrics 


Classification error 


__ # incorrectly predicted observations 
7 total # observations 
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True positive rate 


TPR — # of correctly predicted positive observations 
7 total # of positive observations 
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True negative rate 


# of correctly predicted negative observations 
total # of negative observations 





TNR = 
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Decision tree 
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Decision tree 





e Shallow trees cannot capture more complex connections 
e Deep trees tend to overfit 
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Random forest 


e Consists of many weak learners (shallow decision trees) 
e Each decision tree is built with: 


e Randomly selected subset of observations 
e Randomly selected subset of features 


e Ensemble prediction: weighted vote of each weak learner 
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Random forest 


e Consists of many weak learners (shallow decision trees) 
e Each decision tree is built with: 


e Randomly selected subset of observations 
e Randomly selected subset of features 


e Ensemble prediction: weighted vote of each weak learner 
= Advantage: reduce sensitivity to noise = reduce overfitting 
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Model development 


Observations 
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Model development 


Features 
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Model development 


Features 
| | 7 |_| 





























Observations 





31 


Observations 


Model development 
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Weak learner 
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Weak learner 


€ = Sub test prediction error 
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Weak learner 


€ = sub test prediction error 


a={ J ae e <0.5 


0, otherwise 
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Model development 


Weak learner 1 Weak learner 2 --» Weak learner 100 
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Model development 
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Weighted vote from each weak learner 
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Model development 
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e Prediction results 
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SMOTE 


Synthetic Minority Oversampling Technique (SMOTE) 


Within the training set: 


e Select a positive observation 
e Select one of its nearest neighbors 


e Create a new observation: 
Convex combination of these two observations 


Chawla, N. V., Bowyer, K. W., Hall, L. O., and Kegelmeyer, W. P., SMOTE: Synthetic Minority Over-sampling 
Technique, Journal Of Artificial Intelligence Research, Vol. 16, 2002, pp. 321 357. 
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Prediction results with SMOTE 


e TPR 
= TNR 
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e Concluding remarks 
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Conclusions and future work 


Conclusions 
e Developed a framework to 
e analyze the historical use of reroutes 
e develop models to predict reroute use 
e With improvements, this approach could provide insight 
into advisory use 
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Conclusions and future work 


Conclusions 
e Developed a framework to 


e analyze the historical use of reroutes 
e develop models to predict reroute use 


e With improvements, this approach could provide insight 
into advisory use 


Future work 
e Include weather conditions at fixes and along jet routes 
e Use Convective Weather Avoidance Model (CWAM) 
e Use Collaborative Convective Forecast Product (CCFP) 
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Questions? 


Heather Arneson 
heather.arneson@nasa.gov 
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